U.S. Patent Application Serial No. 10/749,694 



CLAIMS 

The claims are listed as follows: 

1. (Previously Amended) A method of deblurring a video image, comprising the 
steps of: 

downloading a blurred video image comprising a plurality of pixels into a 
systolic array processor, said systolic array processor comprising an array of 
processing logic blocks in parallel such that groups of said plurality of pixels arrive 
in each processing logic block of said array of processing logic blocks respectively; 

sequentially exchanging data between said array of processing logic blocks 
by interconnecting said each processing logic block with only a predefined number 
of processing logic blocks adjacent thereto; 

providing an iterative update of said blurred video image by storing each 
pixel of said plurality of pixels in three planes within said systolic array processor 
wherein said iterative update occurs within said blurred video image video frame 
update rate; and 

uploading a deblurred video image. 

2. (Previously Amended) The method of claim 1, wherein said three planes 
comprises said blurred video image, a blurred video image prediction error and a 
past deblurred video image wherein said array of processing logic blocks provide 
said iterative update of said blurred video image by (i) providing feedback of said 
blurred image prediction error using said deblurred video image and (ii) providing 
feedback of said past deblurred image estimate. 

3. (Previously Amended) The method of claim 2, wherein said iterative update is 
implemented in said each processing logic block by u(n + 1) = u{n) — K *{H *u(n) 
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— y b ) — S * u{n) where u comprises an ideal undistorted image, m and n comprise 
column and row indices of an image pixel element, yb (m,n) comprises an observed 
blurred image, * denotes a 2-D convolution, K comprises a feedback update 
operator with a convolution kernel k(m,n) and S comprises Is a smoothing operator 
with a convolution kernel s(m f n), 

4. (Previously Amended) The method of claim 2, wherein said iterative update is 
implemented in said each processing logic block by u(n + 1; c) = u(n; c) — K *(H 
*u(n; c) —yb (c)) — S * u(n;c) where Yb (c) = yd (j,k;c) comprises a 2-D array of 
color c intensities for said blurred video image encompassing all pixels (j,k) in said 
blurred video image and u(n; c) = u(j,k,n;c) comprises a 2-D array of color c 
intensities for a restored image estimate at iteration number n. 

5. (Previously Amended) The method of claim 1, wherein each group of said 
groups of said plurality of pixels comprises at least one pixel. 

6. (Previously Amended) The method of claim 5, wherein said groups of said 
plurality of pixels comprises a group selected from 2 by 2 pixels, 3 by 3 pixels, and 
4 by 4 pixels. 

7. (Previously Amended) A device for deblurring an image, comprising: 

a blurred video image source comprising a plurality of pixels; 

a systolic array processor adapted to download said blurred video image, 
said systolic array processor comprising an array of processing logic blocks in 
parallel such that groups of said plurality of pixels arrive in each processing logic 
block of said array of processing logic blocks respectively, wherein said processor is 
adapted to sequentially exchange data between said array of processing logic 
blocks by interconnecting each processing logic block of said plurality of processing 
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logic blocks with only a predefined number of processing logic blocks adjacent 
thereto and wherein said systolic array processor is adapted to provide an iterative 
update of said blurred video image by storing each pixel of said plurality of pixels in 
three planes within said systolic array processor wherein said iterative update 
occurs within said blurred video image video frame update rate, and wherein said 
systolic array processor is further adapted to upload a deblurred video image. 

8. (Previously Amended) The device of claim 7, wherein said three planes 
comprises said blurred video image, a blurred video image prediction error and a 
past deblurred video image and wherein said processor is adapted to provide an 
iterative update of said blurred video image by (i) providing feedback of said 
blurred video image prediction error using said deblurred video image and (ii) 
providing feedback of said past deblurred video image estimate. 

9. (Previously Amended) The device of claim 8, wherein said systolic array 
processor includes an iterative update implemented in said each processing logic 
block by u(n + 1) = u(n) — K *(H *u(n) -y b )S* u(n) where u comprises an ideal 
undistorted image, m and n comprise column and row indices of an image pixel 
element, y b (m,n) comprises an observed blurred image, * denotes a 2-D 
convolution, K comprises a feedback update operator with a convolution kernel 
k(m,n) and S comprises a smoothing operator with a convolution kernel s(m,n). 

10. (Previously Amended) The device of claim 9, wherein said operators H, K, 
and S are preloaded in said each processing logic block. 

11. (Previously Amended) The device of claim 8, wherein said iterative update is 
implemented in said each processing logic block by u(n + 1; c) = u(n; c) — K *(H 
*u(n; c) - y b (c)) — S * u(n;c) where y b (c) = y d (j,k;c) comprises a 2-D array of 
color c intensities for said blurred video image encompassing all pixels (j,k) in said 
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blurred video image and u(n; c) = u(j,k;n;c) comprises a 2-D array of color c 
intensities for a restored image estimate at iteration number n. 

12. (Previously Amended) The device of claim 7, wherein each group of said 
groups of said plurality of pixels comprises at least one pixel. 

13. (Previously Amended) The device of claim 12, wherein said groups of said 
plurality of pixels comprises a group selected from 2 by 2 pixels, 3 by 3 pixels, and 
4 by 4 pixels. 

14. (Previously Amended) A device for deblurring a video image, comprising: 
image means for providing a blurred video image comprising a plurality of 

pixels; 

systolic array processor means for processing said blurred video image and 
adapted to download said blurred video image, said systolic array processor means 
comprising an array of processing logic block means in parallel for processing 
groups of said plurality of pixels in each processing logic block of said array of 
processing logic blocks respectively, wherein said processor means is adapted to 
sequentially exchange data between said array of processing logic block means by 
interconnecting said each processing logic block means with only a predefined 
number of processing logic block means adjacent thereto and wherein said systolic 
array processor means is adapted to provide an iterative update of said blurred 
video image by storing each pixel of said plurality of pixels in three planes within 
said systolic array processor means wherein said iterative update occurs within said 
blurred video image video frame update rate, and wherein said systolic array 
processor means includes means for uploading a deblurred video image. 

15. (Previously Amended) The device of claim 14, wherein said three planes 
comprises said blurred video image, a blurred video image prediction error and a 
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past deblurred video image and wherein said systolic array processor means is 
adapted to provide an iterative update of said blurred video image by (i) providing 
feedback of said blurred video image prediction error using said deblurred video 
image and (ii) providing feedback of said past deblurred image video estimate. 

16. (Previously Amended) The device of claim 15, wherein said systolic array 
processor means includes means for an iterative update implemented in said 
systolic array processing logic block means by u(n + 1) = u(n) — K *(H *u(n) — 
Yb)—S* u(n) where u comprises an ideal undistorted image, m and n comprise 
column and row indices of an image pixel element, y& (m,n) comprises an observed 
blurred video image, * denotes convolution, K comprises a feedback update 
operator with a convolution kernel k(m,n) and S comprises a smoothing operator 
with a convolution kernel s(m.n). 

17. (Previously Amended) The device of claim 16, wherein said operators H, K, 
and S are preloaded in said each processing logic blocks. 

18. (Previously Amended) The device of claim 15, wherein said iterative update is 
implemented in said each processing logic block by u(n + 1; c) = u(n; c) — K *(H 
*u(n; c) — Yb (c) ) — 5 * u(n;c) where yt (c) = yd (j,k;c) comprises a 2-D array of 
color c intensities for said blurred video image encompassing all pixels (J,k) in said 
blurred video image and u(n; c) = u(j,lc;n;c) comprises a 2-D may of color c 
intensities for a restored image estimate at iteration number n. 

19. (Previously Amended) The device of claim 14, wherein each group of said 
groups of said plurality of pixels comprises at least one pixel. 
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20. (Previously Amended) The device of claim 19, wherein said groups of said 
plurality of pixels comprises a group selected from 2 by 2 pixels, 3 by 3 pixels and 4 
by 4 pixels. 
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